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A 1 LAW FOR VERTEX-REINFORCED RANDOM WALKS ON 

Z WITH WEIGHT OF ORDER fc", a < 1/2. 

BRUNO SCHAPIRA 



Abstract. We prove that Vertex Reinforced Random Walk on Z with weight 
r^ _ of order k", with a S [0, 1/2), is either almost surely recurrent or almost surely 

r^ , transient. This improves a previous result of Volkov who showed that the set 

of sites which are visited infinitely often was a.s. either empty or infinite. 



Q> ■ 1. Introduction 

Mh I Linearly vertex reinforced random walks (VRRW for short), introduced by Pe- 

,S^ • mantle in [P], were first studied on Z by Pcmantle and Volkov |PV] . who showed 

j^ I that with positive probability these processes spend all large times on just five sites. 

Some times later, Tarres |T1) managed to prove that this striking phenomenon, 

called localization, occurs in fact almost surely (and he recently gave a simplified 

proof in |T2j ). Roughly in the mean-time Volkov [Vlj proved that (linearly) VRRW 

\N I localize as well on a large class of graphs with positive probability and almost surely 

on trees. Benaim and Tarres |BT] have recently generalized his result to a larger 
f— •} I class of walks, with a completely different proof. 

iy~j ■ In the recent works |ETW1[ IETW2J , new models of self- interacting random walks 

CN I are introduced, where the interaction is not restricted to nearest neighbors. Then 

r~^ ■ the authors prove that localization can occur on sets of arbitrary size, depending 

^^ I on the parameters of the model. 

What emerges from these remarkable results is the fact that, when studying self- 
interacting (or non Markovian) random walks on graphs, the first thing one should 
do is to determine the set of vertices which are visited infinitely often and see if 
this is empty, the whole graph or some nontrivial subgraph. According to Volkov's 
notation [V2) we shall denote this set by R' here. If it is the whole graph, we say 
C^ I that the walk is recurrent and if it is empty we say that the walk is transient. But 

as we just saw, it might be equal to something else and even have arbitrary size. 

In 2006 Volkov started the study of VRRW on Z with some weight {wk, k > 0). 
Such process, say (X„,n > 0), is defined as follows. First Xq = 0. Then for all 
n > 0, on the event {X„ — x}, 



(1) P(X„+i - X„ ± 1 I J-„^ - ^^"(-±1) 



where (J-'„, n > 0) is the natural filtration of X and for all y £ Z, 

Zn{y) = #{to <n : Xm^y}, 

is the local time in y at time n. Linearly VRRW correspond to the case when 
Wfc = fc -I- 1 for all A: > 0. Volkov |V2j showed that when ^j, l/wk is finite, then X 
almost surely localizes on two sites, i.e. that R' has a.s. cardinality 2, and when 
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Wk X {k + l)"|j for some a € [0, 1), then a.s. R' cannot be nonempty and finite 
(actually he proved this result under slightly more general hypotheses, see [V2| for 
details). He conjectured also that the process should be a.s. recurrent, i.e. that R' 
should be a.s. equal to Z (Problem 3 in V2 ). It is even natural to believe that 
this should hold as soon as Wk — 0(fc"), for some a < 1, and not only when Wk is 
exactly of order A:", for some fixed a. However, to our knowledge, no progress on 
this conjecture has been made since then, even in the case a = 0. Here we obtain 
the following result: 

Theorem 1.1. Assume that there exists some a G [0, 1/2), such that Wk >: (fc+1)". 
Then the VRRW on Z with weight {wk,k > 0) is either a.s. recurrent or a.s. 
transient. 

This result says that R' is either a.s. empty or a.s. equal to Z. This first step 
toward Volkov's conjecture, called Problem 1 in |iV2,;, gives strong evidence that 
the conjecture should be true, at least when a < 1/2. Indeed since the process is 
"reinforced" it should be "more" recurrent than simple random walk and since it 
does not localize it should be recurrent. However, giving a rigorous proof to this 
kind of monotonicity argument (even formulating a correct statement) is still a real 
challenge. 

For other results on VRRW, particularly on finite graphs, we refer the reader to 
[Bl IBT[ ILV[ IP] . We shall also mention that analogous results have been obtained 
in a continuous setting, for self-interacting diffusions, see |CL Jl iHRl [R] . 

Our proof is different from Volkov's proof, which was based on urns arguments 
and on Rubin's construction. We use instead a kind of domino principle, which 
works roughly as follows. Assume that some site a; < is visited infinitely often, 
but not a; — 1, and let us fix some small constant e > 0. Then at fc-th visit to x, 
with k large, the local time in a; + 1 has to be at least of order fc^/"~^. Otherwise, 
X would have jumped roughly k°"^ times on a; — 1, which is not allowed if k is large. 
Then we repeat this argument and show that before the fc^/"~'-th visit to a; + 1, the 
local time in a; + 2 has to be at least of order k"' , with 7 = 1/a + (1/a — 1)^ — e/a. 
Otherwise, during the k^'°'~'^ visits to a; + 1, X would have jumped more than k 
times to x. By repeating this argument infinitely often, we get that the local time 
in X + i has to be of order k"'', with 7^ of order (1/a — 1)', for all i > 1. This is of 
course not possible before the time of k-th visit to x, and we get a contradiction. 
However this argument only works when 7^ ^^ cx), when z — >■ 00, which explains 
why we need the hypothesis a < 1/2. Then we deduce that a.s. R' is either empty 
or equal to Z, see Sections [3] and [4] for more details. To see that there is really a 
0—1 law, we use the general Lemma l2 . II below, which enables us to conclude with 
Borel-Cantelli like arguments. 

2. A GENERAL LEMMA 

Let us introduce some new notation. For any w — {wk{x))x£Z,k>o, denote by P^, 
the law of the VRRW in the " environement" w. This process is defined as in (jT]) 
except that in the right hand side we replace wz„(x±i) by Wz„{x±i){x ± 1). 

Lemma 2.1. If Q has positive probability under P to be visited only finitely many 
times, then for all w G (0, 00)^^'*', such that Wk{x) — Wk for all x > Q and k > 0, 



we say that /j, x g^ when ft/ 9k is bounded from above and below by positive constants 
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the probability under ¥w that is visited only at time is also positive. In particular 
V{Xn > Vn > 0) > 0. 

Proof. By using a symmetry argument we know that there exists some M > such 
that V{Xn > for all n > M) > 0. By conditioning now with respect to the first 
Af steps, we see that there must exist some sequence (xq, . . . , xm), with xm > 0, 
such that conditionally on E — {(^o, • • ■ ,Xm) — {xq, . . . ,xm)}, the probability 
that Xn > for all n > M is positive. But for any such sequence and any w as in 
the lemma, we have P^(_E) > 0, and since Wk{x) = Wk when a: > 0, we have 

P^(X„ > for aU n> M \E) ^ P(X„ > for aU n > M \ E) > 0. 

Note that if X follows the path {xq, . . . ,xm) during the first M steps and after 
stays on the right of 0, then certainly it always stays on the right of —M. Thus we 
also have 

(2) P^(X„ > -M for alln> 0) > 0. 

Now if w' — iw'i^{x))k>o^xei. is such that for all fc > 0, w'^.{x) = w^+i if a; < 0, and 
^fc('^) — Wk ii X > 0, then by using the Markov property we get 

P^(X„ > Vti > 0) > P„(Xi = 1,...,Xm = M)Fy,,{Xn > -M Wn > 0). 

The first probability on the right hand side is positive (since wq > by hypothesis), 
and it follows from ([2]), with w' in place of w, that the second one is also positive. 
This finishes the proof of the lemma. D 

3. An induction argument and a new proof of Volkov's result 

We first present a kind of domino principle. In plain words it works as follows. 
Assume that there exists some a; G Z, such that inf R' — x. It means that x is 
visited infinitely often, but not x ~ 1. To simplify assume even that x ~ 1 has 
never been visited. Fix some large integer k and let n be the time of fc-th visit 
to X. Then at each of the k first visits to x, the process has probability at least 
of order 1/Z„(x + 1)" to jump to a; — 1. Since it did not, this implies with high 
probability that Z„(x + 1) is at least of order fc^/". The idea is then to repeat the 
argument. More precisely the next lemma implies by induction that the local time 
in a; + i at time n is of order at least fc"*"', with 7^ = '^j^oi^/a — 1)^, up to some 
error term and with probability going to 1 exponentially fast when fc — ^ cx). In 
particular when a < 1/2 the error term is negligible and we get a contradiction, 
since the process X cannot visit an infinite number of sites before time n. See the 
next subsection for details. When a is larger than or equal to 1/2, the error term 
becomes predominant when i — >■ 00, and the argument blows up. However, it still 
implies that R' cannot be finite, which gives an alternative proof to Volkov's result, 
see Corollary [33] below. 

Now for a; e Z and fc > 1, set 

Tx{k)=mi{n>0 : Zn{x) > k}. 

Denote also by T^ := Tx{l) the hitting time of x. In the following each time 
we consider an event of the type {T < T'}, for two random times T and T', we 
implicitely assume that it is contained in the set {T < 00}. 



7;+i(F) < TAk) hT^+2{k—+'-') 



i^ + l-e^ 



< 
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Lemma 3.1. Assume that there exists some a £ [0, 1), such that Wk >^ (k + 1)". 
Then there exist constants c > and C > 0, such that for all x £ Z,, all j > 1, all 
e e (0, a) and all k > e'^^", 

' |lne|i/(i-a) 
Proof. Let e G (0,a) and 7 > 1 be given. Consider the event 
^0 := {T,+i(fc^) < T,(fc) A T,+2(fcT')} , 
where 7' :== (7- l)/a+ 1 - e. Set X = [3 hie/ In a]. For i = 1, . . . , i^, set 



exp 



f ■ — T 



2; + l 



{K-i + 1) 
and for i > 2, 

iV„ = '' '' 



{K-i + lf {K~i + 2Y' 
Set also iVi = k? jK"^ . Note that by hypothesis, if C > is large enough, 

(3) Ni>k'< l(K-i + 2f>\, 

for all i < K, and thus ti < ti+i. Moreover, since Wk >i fc", there exists some 
constant cq G (0, 1), such that for all ip < jo, all * > io and all j < joj uii/{wi+Wj) > 
coio/jo- In particular before time T^(fc) A Tx+2{k'^ ), at each visit to a; + 1, the 
probability to jump to a; is larger than pi := co/fc"'*' . Thusifti < Tx{k) ATx+2{k'^ ), 
as it is the case on the event Aq for instance, then the number of jumps from x + 1 to 
X before time ti + 1 stochastically dominates the sum of Ni independent Bernoulli 
random variables with parameter pi. Therefore, 

P[Ao, Zi+tAx) < Nipi/2] < exp(-ci7Vipi), 

for some constant ci > 0. Define next inductively p2, ■ ■ ■ ,Pk, and Ai, . . . , Ak+i, 

by 

for i G {2,. . .,K}, and 

A, -.^ Ao n {Zi+t,{x) > N,pj2} , 

for i G {l,...,if + l}. Now by using the same argument as above, we immediately 
get by induction that 

(4) P [A,_i, Zi+tM < N,p,l2] < exp i-ciN,p,) , 

for alH G {2, . . . , iiT + 1}. It is also straightforward to prove by induction, and by 
using dS]), that 

(5) N,p. > -3E^1^ ^ 



,1-Q +Q£ 



\c^-i 



(n;=i(^-j+2) 

for all i < K. On the other hand it is immediate that 

K 

supY[{K-j + 2)°''''' <oo. 



K . , 
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Thus there exists a constant c' > such that 

NkPk > c'fcl^"''+"^ 

By taking now e > C/ In k, with C large enough, we deduce that NkPk/^ > fc + 1. 
Since on Aq, tx = Tx+i{k"') < Tx{k), we get that Ak+i is empty. Finally note 
that for alH < A", 






so we also deduce from (JU and ^ that 



K+l 



P[Ao] < ^^[A,^u Zi+u{x)<N,p,/2] 
i=i 

< (if + l)exp(-C2fci~"/|lne|i/(i-")) 

< exp(-cfci-"/|lne|i/(i-")), 

for some positive constants C2 and c. This finishes the proof of the lemma. 



D 



We can now give an alternative proof to Volkov's result, in the case when Wk is of 
order fc". 

Corollary 3.1. Assume that there exists a £ [0, 1), such that Wk >i (fc + 1)". Then 
a.s. \R'\ e {0,oo}. 

Proof. Fix some x G Z and some integers iV > 1 and zq > 0. We want to prove that 
the event {Zao{x) = oo} fl {Zao{x — 1) < zo} n {Zodx + N) < 1} has probability 
zero, with the convention Zoo{y) '■= lim„^oo Zn{y), for all y G Z. 

For this first observe that for any e < 1/a, and any m > 1, 
P [r,(m) < T,+i(77ii/"-^) A T^-iizo) 



< 






< e 



-c(zo) m" 



where c{zq) is some constant and the ^j's are i.i.d. Bernoulli random variables with 
parameter c'm~i+'^", for some other constant c' > 0. 

Now define 71, ... , jn, by 71 = 1, 72 = 1/a — e, and for i > 1, 

li+2 = 7i(l - e) + -(7^+1 - 7*)- 
a 

Note already, that if e is small enough, then 7J+1 > 7j, for alH < A^ — 1. Thus, as 
soon as m is large enough, we can apply Lemma l3. II with k ~ vrC^ and 7 = 7i+i/7i, 
for any i 6 {1, . . . , A^ — 1}, and we get 



'[r,+,(mT'+i) < Tx+^-l{m'^) ^Tx+^+l{m^^+^)] < exp -c 



-j7i(l-a) 

I lne|i/(i-") ; ' 
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where c is the constant appearing in Lemma l3. II Then, 

p [{z^{x) = 00} n {z^{x - 1) < zo} n {z^{x + N)< 1}] 

= P[n™^oo{T,(m)<T,_i(zo)}n{Zeo(a; + iV) < 1}] 
= hm P[{T,(m)<T,_i(zo)}n{Zoo(2: + iV)<l}] 



< hm 

m— >-oo 
Af-1 



{P [r,(m) < T,+i(mi/"-^) A T,_i(zo) 

^ P [r,+,(mT-+o < r,+,_i(m^-) A r,+,+i(m^-+^)] } 



= 0, 
as wanted. Since this is true for any x, N >\ and zq, this proves the coroUary. D 

4. Proof of Theorem 11.11 
We assume in this section that a < 1/2. 
For X <Q and tti > 1, consider the event 

Ex{m) := {Tj.(to) < T^-i} . 

Then for i > 1, set e^ = J'/i^, with r > some positive constant which wih be fixed 
later. Consider the sequence (7^, i > 1) defined inductively by 71 = 1, 72 = (1/a)— r 
and for J > 1, 

7^+2 = 7i(l - eO + -(7-*+i - li)- 
a 

Set 

F,(m) := {T,+,(mT'+i) < r,+,_i(mTO for ah z > 1} . 
Let us show that if r is small enough, then 

(6) sup P[F,(m)=nS,(m)] = o(e-''™'' 

x<0 ^ 

as m ^ 00, for some constant k > 0. For this note that for all i > 1, 

7»+2 - 7^+1 = ( 1)(7*+1 - 7z) - <^^l^: 

a 
so by induction we get 

1 ' 1 

(7) 7»+2-7»+i = (72 -7i)( l)'-y]ej7j( 1) 



i=i 



1-2 

a. 



In particular 7^+2 — 7i+i < (l/o^ ~ l)'^^j for all i > 1, which implies 7^ < Co(l/a — 
1)*, for some constant Co > 0. Since X] 1/*^ < c«j we see from ([7| that if r > is 
small enough, then there exists a constant co > 0, such that 

7i+2 -7i+i > co( !)'• 

a 

Thus 7i+2 > co(1/q; — 1)', for all i > 1, and since a < 1/2, 7^ grows exponentially 
fast with i. Therefore, as soon as m is large enough, we can apply Lemma |3 . 1 1 with 
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k = Trf^ 7 = 7i+i/7i and e = e^, for all i > 1. Then we get 

nF.,{mf r^ E^{m)] < P [T,(m) < r,+i(m'^-) A T,_i(zo)] 



j>i 



< 



^exp 



7i(l-Q) 



|lne,|i/(i-") 



where c is the constant appearing in Lemma [3.11 and k some other constant, see 
the proof of Corollarv l3.1l Since 7^ grows exponentially fast with i, ^ follows. But 
for any x < and any m > 1, the event Fx{m) n Ex{m) is empty since X cannot 
visit infinitely many sites in finite time. This proves that 



(8) supP[£;,(m)]=0(e-'^"™) 



a:<0 



as well, when vn — ^ 00. This proves in particular that for all x < 0, '¥\C\mEx(jn)\ = 0. 
This means that a.s. the process cannot visit i.o. x and never x — 1. Actually the 
proof shows as well that for any x G Z, a.s. the process cannot visit x i.o. and only 
finitely many times x — 1. Similarly, if E'^(m) := {Tx{m) < T^+i}, for x > 0, then 



(9) supP[£;;(m)] = O fe"'"""") 

fr>n V / 



a;>0 

as ?77, — > cxD, and we can see that a.s. the process cannot visit i.o. some x G Z, 
and only finitely many times x + 1. In other words, we just proved that a.s. either 
R' = Z or R' = 0. 

Now observe that by using Lemma 12.11 if ^[Xn > Vn > 0] = 0, then we know 
that is a.s. visited infinitely often. So with the result we just have proved, we 
know that in this case a.s. R' — Z. So it only remains to consider the case when 
¥[Xn > Vn > 0] > 0, which we assume now. We will prove that in this case the 
process is a.s. transient. To this end, note that ([8|) and ([9]) show that 

5^P[{r,(x) < T,+i} U {T_,(x) < T_,_i}] < +00. 

Thus according to Borel-Cantelli's lemma, a.s. for x large enough, either T^+i < 
Tx{x) or T-x-i < T-x{x). For n > 1, denote by x„ the n-th site visited by X, such 
that Tx^ < T2;^_i(x„ — 1) and x„ > 0, or T^^ < r^^+i(|x„ + 1|) and x„ < 0. Note 
that |x„| is at most of order n, so that for all n, if for instance x„ > 0, then X has 
probability of order at least n~" to jump to x„ + 1 at time T^^, and similarly if 
x„ < 0. Hence, 



E 

n>l 



/ ^ ^ iTx^+i = r:c„ + 1 or T^^-i = r^„ + 1 I ^T,„] = 00. 



It then follows from Levy's conditional Borel-Cantelli's lemma (see for instance 
Lemma 5.1 in I T2J '). that a.s. for infinitely many n > 1, either T^^+i = T^,^ + 1 (if 
x„ > 0) or Tx^-i = Tx^ + 1 (if x„ < 0). But each time this happens, by using our 
assumption we see that, independently of !Ft^ , X has some positive probability 
p > to never come back to Xn after time T^^- It follows that a.s. this happens 
infinitely often, which proves well that X is a.s. transient, as wanted. D 
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